Positional Encoding Methods: Implementation Report
A deep-dive into 5 positional encoding strategies with mathematical formulations, code walkthroughs, architectural diagrams, and comparative analysis
Read more →Writing about GPU & Compilers
Research notes on efficient AI, hardware, and the systems behind them.
3 articles about GPU & Compilers
Newest first
Intro to Triton with Matrix Multiplication
Introduction to GPU programming with Triton and build the matrix multiplication along the way
Read more →
Quantization Aware Training Implementation Guide
Implementation details and best practices for Quantization Aware Training (QAT) with LoRA, including GPU memory optimization strategies
Read more →